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This  paper  was  submitted  to  the  Subcommittee  on  Elementary,  Second- 
ary, and  Vocational  Education,  Committee  on  Education  and  Labor,  U.S. 
House  of  Bepresentatlves  for  its  hearings  on  the  reauthorlzatlon  of 
the  Elementary  and  Secondary  Education  Act,  Title  IV.  The  first  section 
submitted  on  July  28,  1977,  consists  of  a summary  of  findings  of  Rand's 
change  agent  study  of  educational  innovations  funded  by  federal  programs. 
The  second  section,  submitted  on  August  10,  1977,  consists  of  policy 
recommendations  for  ESEA,  Title  IV  Consolidated  Programs,  Part  C.  Both 
sections,  along  with  additional  oral  testimony,  will  appear  in  the  Con- 
gressional Record  of  the  hearings. 


PART  I 


In  July  1973,  the  U.S.  Office  of  Education  (USOE)  awarded  a contract 
to  The  Rand  Corporation  to  study  a national  sample  of  educational  Inno- 
vations funded  by  federal  programs.  The  study  aimed  to  help  Improve  fed- 
eral change  agent  policies  by  describing  how  the  process  of  innovation 
works  In  Its  local  setting,  and  by  trying  to  discern  what  factors  affect 
the  Innovative  process  zmd  Its  outcomes. 

This  testimony  summarizes  findings  from  Rand's  research.*  The  views 
and  conclusions  expressed  are  those  of  the  testimony’s  author  and  should 
not  be  Interpreted  as  representing) those  of  The  Rand  Corporation  or  any 
of  the  agencies  sponsoring  Its  research.  Although  the  research  Included 
four  different  federal  programs,  the  following  discussion  will  focus  on 
findings  for  the  Elementary  and  Secondary  Education  Act,  Title  III,  Inno- 
vative Projects,  which  has  now  become  Title  IV  C. 


STUDY  DESIGN 

The  Rand  study  was  conducted  In  two  phases.  The  first  phase  (July 
1973  to  July  1975)  studied  local  innovations  during  their  last  or  next 
to  last  year  of  funding  by  federal  change  agent  programs,  and  the  research 
focused  on  the  Initiation  and  Implementation  of  these  local  projects. 

Four  federal  programs  were  Identified  by  USOE  to  be  Included  in  Phase  I 
of  the  study:  Elementary  and  Secondary  Education  Act  Title  III,  Innova- 
tive Projects;  Elementary  and  Secondary  Education  Act  Title  VII,  Bi- 
lingual Projects;  Vocational  Education  Act,  1968  Amendments,  Part  D,  Ex- 
, ** 

emplary  Programs;  and  Right  to  Read.  Despite  differences  l.i  focus  and 


The  study's  findings  are  reported  In  eight  volumes  under  the  gen- 
eral title  Federal  Programs  Supporting  Educational  Change  (R-1589-HEW) . 
The  appendix  describes  the  contents  of  these  volumes. 

In  FY1974,  the  year  of  the  major  research  activities  of  Phase  I of 
this  study,  the  approximate  funding  levels  of  the  federal  programs  were: 
ESEA  Title  III,  Innovative  Projects,  $150  million;  ESEA  Title  VII,  Bi- 
lingual Projects  $45  million;  Vocational  Education  Act,  1968  Amendments, 
Part  D Exemplary  Programs,  $16  million;  and  Right  to  Read,  $12  million. 
Since  these  programs  have  evolved  since  1974  (e.g. , Title  III  has  become 
consolidated  Into  Title  IV  under  the  1974  Amendments  to  ESEA) , the  dis- 
cussion in  this  testimony  refers  to  the  programs  as  they  existed  during 
the  time  when  the  project  studied  had  federal  funds. 
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management  strategy,  these  change  agent  programs  had  a common  purpose: 
the  stimulation  and  spread  of  educational  Innovations.  They  also  had 
a common  policy  Instrument:  the  provision  of  tenq)orary  funds  (3  to  5 
years)  vdilch,  although  small  relative  to  the  budget  of  a school  district, 
were  Intended  to  fund  new  educational  services,  not  to  support  existing 
practice.  Because  we  studied  four  programs  rather  than  one,  we  were 
able  to  compare  the  Initiation  and  liiQ>lementatlon  of  approximately 
three  hundred  projects  funded  by  the  different  programs. 

Phase  II  (August  1975  - April  1977)  examined  what  happened  to  Inno- 
vative projects  after  the  end  of  the  federal  funding  period.  Accord- 
ingly, two  years  after  the  Initial  field  research,  Rand  restudled  a 
sample  of  approximately  100  of  the  projects,  originally  funded  under 
Title  III  of  ESEA.  By  thus  studying  local  Innovations  one  to  two  years 
after  the  end  of  federal  funding,  we  were  able  to  explore  the  longer 
run  effects  of  the  federal  policy  of  providing  "seed  money"  as  a means 
to  promote  educational  reform. 

THE  FINDINGS 

Our  overall  findings  can  be  stated  quite  simply.  Federal  change 
agent  policies  had  a major  effect  In  stimulating  local  districts  to  un- 
dertake projects  that  were  generally  consistent  with  federal  categori- 
cal guidelines.  This  local  response  resulted  from  the  availability  of 
federal  funds  and.  In  some  programs,  from  guidelines  that  encouraged 
specific  educational  practices.  But  the  adoption  of  projects  did  not 
Insure  successful  Implementation;  moreover,  successful  Implementation 
did  not  guarantee  long-run  continuation.  Neither  those  policies  unique 
to  each  federal  program  nor  those  policies  common  to  all  of  them  strongly 
Influenced  the  fate  of  the  Innovations  that  had  been  adopted  by  the  dis- 
tricts. In  sum,  the  net  return  to  the  federal  Investment  was  the  adop- 
tion of  many  Innovations,  the  successful  Implementation  of  few,  and  the 
long-run  continuation  of  still  fei«er  (with  the  exception  of  the  special 
case  of  bilingual  projects,  where  federal  and  state  funding  continues 
to  be  available). 
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All  the  federal  programs  funded  projects  that  were  Implejiented  suc- 
cessfully, as  well  as  projects  that  were  dismal  failures  and  many  pro- 
jects In  between.  The  difference  between  success  and  failure  depended 
primarily  on  how  school  districts  Implemented  their  projects,  not  on 
the  type  of  federal  sponsorship.  The  guidelines  and  management  strate- 
gies of  the  federal  change  agent  programs  were  simply  overshadowed  by 
local  concerns  and  characteristics. 

The  dominance  of  local  factors  Is  also  Illustrated  by  the  Ineffec- 
tiveness of  a main  policy  Instrument  of  these  "seed"  money  programs — 
namely,  the  size  of  the  grant.  The  projects  In  our  sample  varied  con- 
siderably In  their  level  of  funding,  from  ten  thousand  to  several  hundred 
thousand  dollars  per  year.  The  larger  grants  tended,  not  surprisingly, 
to  be  awarded  to  larger  districts,  to  fund  projects  In  a greater  number 
of  schools,  or  to  fund  projects  that  spent  more  money  per  student.  The 
larger  grants  also  tended  to  support  educatloneil  methods  that  focused 
on  individualization  techniques.  In  this  case,  federal  funds  typically 
were  used  to  hire  the  teacher  aides  necessary  for  Individualizing  class- 
room activities.  By  and  large,  however,  more  expensive  projects  were 
no  more  likely  than  less  expensive  ones  to  be  Implemented  effectively 
or  to  lead  to  changes  In  teachers'  behavior.  More  money  did  not  neces- 
sarily purchase  those  things  that  mattered;  it  did  not  "buy,"  for  ex- 
ample, more  committed  teachers,  more  effective  project  directors,  more 
concerned  principals,  and  so  on.  In  other  words,  project  outcomes  re- 
flected not  the  amount  of  funds,  but  what  the  local  staff  did  with  them. 

This  is  not  to  say  that  "federal  money  doesn't  matter."  Federal 
seed  money  allowed  some  districts  to  undertake  activities  that  their 
staff  were  anxious  to  pursue  but  that  could  not  be  supported  out  of  dis- 
trict funds.  Yet,  the  record  of  the  way  school  districts  used  federal 
grants  Is  spotty.  Many  projects  were  started  simply  for  the  purpose 
of  receiving  federal  largesse  and,  as  far  as  we  could  tell,  without  any 
real  Intention  to  deal  with  central,  or  even  not  so  central,  local  prob- 
lems. The  result  of  this  behavior,  which  we  call  opportunism,  was  pre- 
dictable: opportunistic  projects  were  poorly  Implemented  and  disappeared 
with  the  last  federal  check. 
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Projects  taken  seriously  by  district  officials  and  school  staff 
generally  were  more  likely  to  be  implemented  than  opportunistic  projects. 
But  even  effective  liiq>lementatlon  did  not  always  mean  that  the  longer 
term  federal  objective  of  promoting  stable  change  in  local  practices  was 
achieved.  At  the  end  of  federal  funding,  district  officials  had  to  de- 
cide about  the  continuation  of  a change  agent  project.  This  decision 
was  not  made  primarily  on  the  basis  of  the  project' s educational  success 
during  the  period  of  special  funding,  as  a "seed  money"  model  assumes. 
Instead,  local  organizational  and  political  factors  moderated  and  deter- 
mined the  district's  commitment  to  continue  change  agent  projects,  even 
if  the  project  had  demonstrated  Its  value. 

Moreover,  few  districts  in  our  sample  planned  for  the  long-term 
stability  of  projects.  The  end  of  federal  funding  generally  resulted 
in  a reduction  of  resources  for  most  projects,  particularly  expensive 
ones.  For  example.  Innovations  that  had  used  "soft"  money  to  reduce  the 
student- to- adult  ratio  (e.g. , by  hiring  aides)  were  cut  back  to  live 
within  the  district  budget.  Many  districts  complained  of  Insufficient 
resources  to  carry  on  project  activities  or  to  permanently  fund  extra 
project  staff.  But  financial  difficulties  usually  Involved  questions 
of  budget  allocations  that  could  have  been  foreseen  and  planned  for  from 
the  project's  inception.  Instead,  budget  and  personnel  decisions  typi- 
cally perpetuated  the  "special  project"  status  of  Innovations  and  left 
them  vulnerable  to  the  financial  and  political  fortunes  of  the  district. 

Thus,  few  districts  adequately  prepared  themselves  for  sustaining 
or  spreading  the  changes  resulting  from  even  successfully  implemented 
projects.  This  created  an  anomalous  situation.  Except  for  opportunis- 
tic or  peripheral  projects  that  essentially  were  not  Implemented,  the 
methods  or  materials  of  most  innovations  in  our  sample  were  still  being 
used  to  some  extent  by  teachers  two  years  after  the  end  of  federal  fimd- 
Ing;  yet,  in  most  cases,  the  project's  continued  use  in  the  classroom 
was  not  matched  by  permanent  changes  in  district  procedures  in  budget, 
personnel,  staff  support,  and  instructional  areas  that  would  be  required 
to  maintain  classroom  practices.  The  prognosis  for  the  continued  exist- 
ence of  these  projects  was  poor.  In  most  cases,  the  innovations  fmded 
by  federal  "seed  money"  had  not  taken  root. 
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In  snmnary,  our  findings  cast  serious  doubt  on  the  efficacy  of 
providing  seed  money  to  promote  educational  reform.  Seed  money  does 
stimulate  school  districts  to  adopt  Innovations.  But  It  assures  neither 
successful  Implementation  nor  long-rtin  continuation,  because  these  diffi- 
cult and  uncertain  processes  depend  on  the  characteristics  of  school 
districts  and  the  choices  made  by  them.  The  prospects  for  more  effec- 
tive policy  would  seem  to  lie  in  understanding  these  local  processes 
and  the  factors  within  and  outside  of  the  district  that  affect  them. 

FACTORS  AFFECTING  PROJECT  OUTCOMES 

The  very  complexity  of  the  innovative  process  teaches  us  an  obvious, 
though  often  Ignored,  lesson:  No  simple  or  sure  way  can  be  found  to  ef- 
fect educational  change  and  have  It  persist.  Nor  Is  any  single  factor 
the  answer  to  successful  Innovation,  whether  It  be  money,  a new  tech- 
nique or  a change  In  personnel.  Rather,  the  fate  of  an  Innovation  de- 
pends on  the  complex  interplay  among  characteristics  of  the  Innovative 
project  Itself  and  the  Institutional  setting  It  seeks  to  change.  From 
these  many  characteristics,  we  sought  to  find  out  which  ones  had  system- 
atic and  significant  effects  on  Implementation  and  continuation  across 
a wide  variety  of  projects  and  settings. 

More  specifically,  we  considered  project  outcomes  to  depend  on  two 
classes  of  factors  In  addition  to  federal  policies: 

o Project  characteristics  (educational  method,  project  resources, 
scope  of  proposed  change.  Implementation  strategies) 
o Institutional  setting  (organizational  climate  and  leadership, 
school  and  teacher  characteristics,  district  management  capa- 
city and  support) 

The  remainder  of  this  testimony  discusses  how  much  each  £au:o>:  Influenced 
what  happened  to  local  Innovations. 

Kducatlonal  Methods 

School  people  rarely  adopt  an  Innovation  from  outside  their  dis- 
trict without  changing  It.  Whether  they  wish  to  "replicate"  a specific 
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project  they  saw  or  heard  about  elsewhere,  or  to  apply  a general  educa- 
tional concept  such  as  differentiated  staffing,  project  designers  tend 
at  the  beginning  to  adapt  the  Innovation  to  the  local  setting  as  well 
as  to  their  own  Interests.  For  exai^>le,  a mastery  learning  project  that 
was  successful  elsewhere  may  use  materials  that  are  not  appropriate  for 
the  staff  or  students  of  the  adopting  district.  Or,  district  staff  may 
like  the  reading  Instruction  strategies  of  one  project,  but  prefer  to 
use  the  classroom  organization  methods  of  another.  Moreover,  during 
project  Implementation,  teachers  tend  to  adapt  the  project's  orlglneil 
design  to  their  own  needs  and  to  the  conditions  of  their  classroom. 

These  local  adaptations  mean  that  projects  based  on  essentially  the  same 
educational  methods  can  be,  and  usually  are.  Implemented  very  differ- 
ently and  thus  more-or-less  effectively.  Consequently,  the  specific 
educational  method  chosen  by  a school  district  did  not  accurately  fore- 
cast the  project's  outcomes.  In  short,  what  the  project  was  mattered 
less  than  how  It  was  done. 

Project  Resources 

Our  findings  about  the  effects  of  project  resources  are  similar 
to  those  for  educational  methods:  more  expensive  projects  were  generally 
no  more  likely  than  less  expensive  ones  to  be  effectively  Implemented, 
elicit  teacher  change.  Improve  student  performance,  or  be  continued  by 
teachers.  Nor  did  variations  In  the  number  of  project  schools  per  dis- 
trict or  in  the  funding  per  student  strongly  affect  project  outcomes 
in  most  cases. 

Scope  of  Proposed  Change 

The  scope  of  a change  agent  project — how  much  It  seeks  to  accom- 
plish relative  to  Its  setting — concerns  local  officials  as  well  as  fed- 
eral and  state  planners.  Should  ambitious  and  comprehensive  Innovations 
be  supported,  despite  a possible  high  risk  of  producing  no  change  at 
all,  or  should  narrow,  presumably  "safer"  bets  be  backed?  Our  analysis 
shows  that  this  question  does  Indeed  deserve  serious  attention,  because 
the  project's  scope  Influenced  Implementation  and  continuation  in  many 
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ways.  Though  we  did  find  more  difficulties  associated  with  more  ambl'- 
tlous  efforts,  the  question  has  a deceptively  simple  answer:  Little  ven- 
tured, nothing  gained. 

Our  data  Indicate  that  teachers  rise  to  challenges.  Andjltlous  and 
demanding  Innovations  seem  more  likely  to  elicit  the  commitment  of  teach- 
ers than  routine  projects.  They  do  so  In  part  because  they  appeal  to 
the  teachers'  professionalism;  that  Is,  a primary  motivation  for  teachers 
to  undertake  the  extra  work  and  disruption  of  attempting  change  is  the 
belief  that  they  will  become  "better"  teachers  and  that  their  students 
will  benefit. 

In  summary,  ambitious  and  demanding  innovations  promoted  teacher 
change  and  teacher  continuation  of  project  methods  without  necessarily 
causing  unmanageable  implementation  problems  or  diminishing  gains  in 
student  performance.  Teachers  must  clearly  understand  these  project's 
goals  and  precepts;  such  clarity  ordinarily  comes  during  implementation. 

We  doubt  vrfiether  projects  aiming  at  significant  change  could  be  effec- 
tively implemented  across  the  whole  school  system  at  once.  A wiser 
strategy  would  probably  be  to  go  step  by  step,  so  that  each  school  or 
group  or  schools  can  pass  its  particular  threshold  of  change  before  new 
changes  are  attempted. 

Implementation  Strategies 

In  terms  of  policy  Import,  a major  finding  of  this  study  Involves 
implementation  strategies — the  local  decisions  and  choices,  explicit  or 
implicit,  on  how  to  put  an  innovation  into  practice.  We  found  that 
these  strategies  could  spell  the  difference  between  success  or  failure, 
almost  independently  of  the  type  of  innovation  or  educational  method  In- 
volved; moreover,  they  could  determine  (Aether  teachers  would  assimilate 
and  continue  using  project  methods  or  allow  them  to  fall  into  disuse. 
Inq>lementatloa  strategies  should  be  particularly  lnq>ortant  to  policymak- 
ers, even  though  such  elements  of  the  institutional  setting  as  school 
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leadership  and  teacher  characteristics  had  even  greater  effects  on  the 
project's  fate;  while  there  may  be  no  direct  leverage  on  the  Institu- 
tional setting,  policy  Instruments  might  be  formulated  that  could  Influ- 
ence the  choice  of  Implementation  strategies. 

The  following  strategies  were  particularly  effective  in  helping 
teachers  to  Implement  and  continue  project  activities: 

o Concrete  and  extended  training 

o Classroom  assistance  from  project  or  district  staff 
o Observation  of  projects  in  other  classrooms,  schools,  or 
districts 

o Regular  project  meetings 

o Teacher  participation  in  project  decisions 
o Local  materials  development 
o Principal  participation  in  training 

Institutional  Setting 

An  innovation's  local  institutional  setting  had  the  major  Influence 
on  its  outcomes.  Three  factors  were  particularly  crucial — school  and 
project  leadership,  teacher  characteristics,  and  school  district  manage- 
ment capacity. 

Our  data  leave  little  doubt  that  the  leadership  of  the  project  dir- 
ector and  school  principal  greatly  affected  implementation  and  continua- 
tion. A skillful  project  director  was  able  to  facilitate  effective  im- 
plementation and  build  teacher  commitment  and  support  and  thus  Increase 
the  possibility  that  teachers  would  assimilate  and  continue  project 
features.  The  principal's  support  was  most  crucial  to  project  continua- 
tion. The  districts  examined  in  the  study  sample  often  took  a laissez- 
faire  attitude  toward  the  project  after  the  conclusion  of  the  federal 
grant,  thus  it  was  up  to  the  principal  to  "fight"  for  the  project  and 
protect  it  from  financial,  personnel,  and  political  problems  that  would 
lead  to  its  termination.  All  told,  the  school  principal  amply  merits 
the  title  of  "gatekeeper  of  change." 
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The  characteristics  of  teachers  had  great  weight  on  both  the  short- 
run  and  long-rm  effects  of  projects.  Teachers  have  to  be  flexible  to 
master  new  techniques,  as  well  as  being  committed  to  them.  We  found 
that  the  more  years  of  being  on  the  job,  the  less  susceptible  to  change 
teachers  seemed  to  be.  More  important  than  years  of  teaching,  however, 
was  the  teachers'  attitudes  about  their  own  professional  competence: 
teachers  who  felt  they  could  help  even  the  most  difficult  student  seemed 
to  be  more  flexible  and  open  to  change. 

Districts  differ  sharply  in  their  capacity  to  manage  change  agent 
projects  and  in  their  receptivity  towards  them.  The  study  found  that 
the  constant  and  active  support  of  school  district  officials  and  special- 
ized staff  are  essential  to  the  project's  short-run  outcomes  and  espe- 
cially its  long-run  fate. 

For  example,  supportive  districts  designed  continuation  strategies 
from  the  project's  onset  that  were  aimed  at  maintaining  the  project  in 
the  face  of  financial,  personnel,  and  political  uncertainties.  The  ex- 
act nature  of  these  continuation  strategies  (.as  well  as  their  effective- 
ness) depended  on  the  particular  attributes  of  the  local  setting,  but  the 
broad  outlines  of  their  objectives  can  be  seen. 

They  aimed  to  smooth  the  project's  transition  from  its  "special  sta- 
tus to  its  institutionalization  (i.e.,  to  becoming  a regular  part  of  dis- 
trict operations).  In  the  budget  area,  the  project  had  to  change  its 
status  from  a special  line  item  to  a standard  activity  absorbed  in  the 
district's  operating  budget.  "Political"  groundwork  typically  had  to  be 
laid  to  convince  school  board  members  of  the  project's  priority.  In  the 
personnel  area,  a procedure  for  replacing  key  project  personnel  had  to  be 
established;  for  example,  some  LEAs  use  project  participants  as  "train- 
ing cadre."  In  the  area  of  curriculum  support,  staff  training  and  devel- 
opment needs  had  to  be  incorporated  into  regular  in-service  activities 
if  new  project  members  were  to  be  "brought  on  board"  and  older  ones  kept  ! 

fresh.  In  the  Instructional  area,  projects  had  to  replace  existing  t 
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practices;  this  meant  that  district  officials  once  again  had  to  mobil- 
ize the  support  of  principals  and  teachers. 

In  summary,  from  beginning  to  end,  a supportive  institutional  en- 
vironment was  necessary  for  a project  to  be  effectively  Implemented  and 
to  take  root. 

CONCLUSIONS 

1.  Federal  change  agent  policies  stimulated  the  adoption  of  inno- 
vations consistent  with  federal  priorities,  but  neither  those 
policies  unique  to  each  federal  program  nor  those  policies  com- 
mon to  them  strongly  Influenced  the  fate  of  adopted  innovations. 

2.  Neither  the  resources  available  to  a project  nor  its  educa- 
tional method  greatly  affected  the  project's  outcome  or  con- 
tinuation. Inputs  to  school  districts,  whether  money,  new 
methods,  or  federal  guidelines,  mattered  less  than  other  local 
factors. 

3.  Ambitious  and  demanding  innovations  promoted  teacher  change  and 
teacher  continuation  of  project  methods  without  necessarily 
causing  unmanageable  implementation  problems. 

h.  Locally  chosen  Implementation  strategies  strongly  influenced 
both  the  project's  short-run  outcomes  and  its  longer-run  fate. 

5.  Leadership  of  principals  and  project  directors  was  a vital  fac- 
tor at  both  the  school  and  the  project  level. 

6.  Teachers'  commitment  and  positive  attitudes  toward  their  own 
professional  competence  enhanced  implementation  and  continua- 
tion, whereas  many  years  in  teaching  had  negative  effects. 

7.  A supportive  district  environment  seems  necessary  for  an  inno- 
vation to  be  effectively  implemented  and  sustained. 
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APPENDIX 

i 

The  findings  of  Rand's  study  of  change  agent  projects  are  reported 
in  eight  volumes  tmder  the  general  title  Federal  Programs  Supporting 
Educational  Change  (R-1589-HEW) . A series  of  five  reports  describes 

the  results  of  the  first  phase  of  the  research:  9 

Volume  I (R-1589/1-HEW,  A Model  of  Educational  Change)  provides  a 
theoretical  perspective  for  the  Rand  study  by  analyzing  the  current 
state  of  knowledge  of  planned  change  In  education  and  by  proposing  a 
conceptual  model  of  factors  affecting  change  processes  within  school 
districts. 

Volume  II  (R-1589/2-HEW,  Factors  Affecting  Change  Agent  Projects) 
contains  the  analysis  of  survey  data  collected  from  a national  sample 
of  293  projects  In  18  states  during  November  and  December  1973. 

Volume  III  (R-1589/3-HEW,  The  Process  of  Change)  summarizes  the 
findings  and  policy  Implications  resulting  from  29  case  studies  of 
change  agent  projects  conducted  by  Rand  staff  members  and  consultants 
In  25  school  districts  during  April  and  May  1974.  These  case  studies 
were  chosen  from  the  original  sample  of  293  projects  initially  surveyed. 

Volume  III  also  describes  the  role  of  state  education  agencies  In  select- 
ing, managing,  and  disseminating  the  change  agent  projects. 

Four  technical  appendixes  to  Vol.  Ill  describe  in  detail  the  fed- 
eral program  management  approach,  state  education  agency  participation, 
and  case  studies  for  each  of  the  programs  In  the  study:  Title  III,  App. 

A;  Reading,  App.  B;  Bilingual  Education,  App.  C;  and  Career  Education, 

App.  D.  Appendix  A should  be  of  particular  Interest  to  researchers  or 
practitioners  concerned  with  the  Introduction  of  new  approaches  to  class- 
room Instruction. 

Volume  IV  (R-1589/4-HEW,  The  Findings  In  Review)  summarizes  the 
findings  of  Vols.  I,  II,  and  III,  and  also  synthesizes  extensive  data 
collected  by  Rand  on  federal- level  program  strategy  and  management  for 
each  of  the  change  agent  programs.  Volume  IV  also  includes  a discussion 
of  alternative  federal  strategies  for  promoting  innovation. 

L_ ~ 
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Volume  V (R-1589/5-HEW,  Executive  Summary)  summarizes  the  first 
phase  of  the  research  for  a general  audience. 

The  results  of  the  final  phase  are  reported  in  three  volumes: 

Volume  VI  (R-1589/6-HEW,  Implementing  and  Sustaining  Title  VII  Bi- 
lingual Projects) , discusses  the  complex  process  of  establishing  bi- 
lingual programs  in  local  school  districts,  with  particular  attention 
given  to  those  aspects  of  the  Title  VII  program  and  to  those  political 
Influences  that  affect  local  implementation.  The  fieldwork,  viewpoint, 
and  data  interpretation  build  on  the  extensive  empirical  work  done  in 
the  first  phase  of  the  study  and  reported  in  Vol.  Ill,  App.  C ( Innova- 
tions in  Bilingual  Education.  R-1589/3-HEW) . 

Volume  VII  (R-1589/7-HEW,  Factors  Affecting  Implementation  and  Con- 
tinuation) presents  an  analysis  of  the  survey  data  collected  in  100 
Title  III  projects  in  20  states.  This  volume  deals  specifically  with 
the  questions  of  implementing,  sustaining,  and  spreading  part  or  all  of 
special  project  strategies  after  federal  support  ends. 

Volume  VIII  (R-1589/8-HEW,  Implementing  and  Sustaining  Innovations) 
summarizes  the  findings  from  both  phases  of  the  study  and,  drawing  on 
these  results,  describes  the  process  of  change  at  the  local  level — initiat- 
ing, Implementing,  sustaining,  and  spreading  innovative  projects.  Vol- 
ume VIII  also  Includes  a discussion  of  policy  Implications  that  derive 
from  this  study. 
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PAFtl  II 

In  July  1973,  the  U.S.  Office  of  Education  awarded  a contract  to  ^ 

The  Rand  Corporation  to  conduct  a four-year  study  of  a national  sample 
of  educational  innovations  funded  by  federal  programs.  The  study's 
findings  were  reviewed  in  both  written  and  oral  testimony  delivered  to 
the  Sub  commit  tee  on  Elementary,  Secondary,  and  Vocational  Education  on 
July  28,  1977.  Based  on  these  findings,  this  testimony  offers  policy 
recomnendatlons  relevant  to  the  ESEA  Title  IV  Consolidation  Programs. 

The  views  and  conclusions  expressed  are  those  of  the  testimony's  authors 
and  should  not  be  interpreted  as  representing  those  of  The  Rand  Corpora- 
tion or  any  of  the  agencies  sponsoring  its  research. 

SUMMAfK  OF  FINDINGS 

Before  making  policy  recommendations,  the  following  three  main  find- 
ings summarize  our  previous  testimony: 

1.  Federal  change  agent  policies  had  a major  effect  in  stimulat- 
ing local  districts  to  undertake  projects  that  were  generally 
consistent  with  federal  categorical  guidelines.  This  local  re- 
sponse resulted  from  the  availability  of  federal  funds  and,  in 
some  programs,  from  guidelines  that  encouraged  specific  educa- 
tional practices. 


However,  school  districts  often  did  not  or  could  not  carry  out 
the  adopted  innovations  in  ways  that  Improved  local  educational 
practice.  We  call  this  the  implementation  problem.  Moreover, 
even  when  school  districts  overcame  Implementation  difficulties 
and  successfully  Implemented  their  projects,  they  often  did  not 
continue  them  after  the  end  of  federal  funding.  In  sum,  the  net 
return  to  the  federal  Investment  was  the  adoption  of  many  innova- 
tions, the  successful  implementation  of  few,  and  the  long-run 
effective  continuation  of  still  fewer  (with  the  exception  of  the 
special  case  of  bilingual  projects,  where  federal  and  state  fund- 
ing continues  to  be  available) . 
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2.  Federal  or  state  assistance  (money,  technology,  or  Information) 
to  school  districts  can  have  only  a marginal  effect  on  the 
short  and  longrun  outcomes  of  local  Innovative  efforts  because 
such  assistance  has  limited  leverage  on  how  successfully  local 
projects  are  Implemented  and  sustained.  Successful  educational 
change  required  effective  local  leadership  (particularly  from 
principals  and  project  directors) , competent  and  committed 
teachers,  and  school  district  officials  with  highly  developed 
management  skills.  Only  ambitious  and  demanding  Innovations 
were  likely  to  produce  teacher  change  and  longrun  Improvement 
In  educational  practices. 

3.  Few  school  districts  have  the  management  skills,  motivations, 
and  Institutional  capacity  to  Implement  or  sustain  planned 
change.  To  Improve  educational  practices,  they  need  discretion- 
ary resources,  technical  assistance,  support  for  leadership 
training  and  staff  development,  and  federal  and  state  guidance 
to  help  choose  among  competing  local  priorities. 


POLICT  REbOMHEl^tAIIONS 


' V 


Title  IV  C provides  much  needed  discretionary  funds  to  school  dis- 
tricts for  Innovative  efforts  and  should  be  contlnued^x  The  main  effect 
of  federal  "seed"  money  programs  has  been  to  stimulate  the  adoption  of 
local  Innovations  which  occurred.  In  part,  because  these  outside  funds 
were  not  obligated  to  pay  for  existing  district  operations.  Title  IV  C 
Is  one  of  the  few  programs  that  provide  school  districts  with  discretion- 
ary resources  and,  more  Importantly,  with  a legitimate  charter  to  Improve 
their  educational  practices.  The  Importance  of  this  program  for  promot- 
ing Improvement  may  Increase  because  of  the  current  trend  of  ^^latlvely 
tight  local  financial  conditions  and  declining  student  enrollments^ - ' 


* 
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The  consolidation  of  Innovative  programs  holds  the  promise  of  pro- 
moting greater  efficiency  and  flexibility  In  the  use  of  special  project 
funds  at  the  local  level.  However,  to  realize  this  promise,  school  dis- 
tricts should  be  encouraged  to  "consolidate"  the  various  support  activi- 
ties that  accompany  special  projects.  For  example,  evaluation,  planning, 
staff  assistance,  and  staff  training  are  often  conducted  for  each  special 
project  Independent  of  other  projects;  these  services  could  be  delivered 
more  efficiently  If  LEAs  offered  consolidated  services  for  all  special 
projects. 

2^  States  should  award  Title  IV  C funds  to  local  school  districts  on  a 
competitive  basis  but  within  a framework  of  targeted  federal  or  state 
priori ties/  The  competitive  aspect  of  the  Title  IV  C program  helps  to 
Insure  a genuine  local  Interest  and  effort  In  a proposed  Innovative  un- 
dertaking. There  are,  however,  three  disadvantages  to  a fully  competi- 
tive system.  First,  some  school  districts  have  become  proficient  at 
"grantsmanshlp,"  which  allows  them  to  win  awards  opportunistically  with- 
out a commitment  to  solving  local  problems;  recommendation  3,  below,  ad- 
dresses this  difficulty  by  suggesting  a grant  system  that  encourages 
planning  and  commitment.  Second,  a competitive  system  tends  to  favor 
school  districts  that  have  more  developed  management  skills  and  thus  are 
relatively  less  In  need  of  special  project  funds.  The  existing  Title  IV 
legislation  recognizes  this  problem  and  encourages  states  to  make  a 
special  effort  to  reach  out  to  the  less  competitive  LEAs  so  that  they  can 
develop  the  skills  to  receive  a Title  IV  C grant.  However,  the  Inabil- 
ity of  these  school  districts  to  compete  Is  often  symptomatic  of  a more 
general  deficiency.  They  typically  lack  management  skills  and  staff 
development  capabilities,  so  that  they  would  have  great  difficulty  Im- 
plementing Improved  educational  practices  even  If  they  were  to  receive 
a Title  IV  C grant.  (For  these  reasons,  recommendation  4 suggests  a 
different  type  of  grant  to  supplement  the  usual  competitive  award.) 

Third,  the  local  projects  awarded  under  a ccsnpetltlve  system  may 
serve  neither  federal  or  state  priorities,  nor  even  local  needs.  Assum- 
ing that  consolidation  keeps  the  reporting,  evaluation,  and  accounting 
procedures  to  a minimum,  local  officials  who  are  really  Interested  In 
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liq>rovlng  educational  practice  would  value  categorical  provisions  In  fed- 
eral or  state  funds:  categorical  grants  give  them  a mandate  and  legiti- 
macy to  mobilize  support  for  special  needs  within  their  commimlty  and 
school  system.  Many  district  officials  have  told  us,  for  exaiqple,  that 
If  Title  1 funds  were  not  earmarked  for  coiiq>ensatory  purposes,  It  would 
be  difficult  to  sustain  conq>ensatory  programs  In  the  face  of  powerful 
pressures  within  the  district  for  access  to  those  resources.  In  short, 
the  priorities  set  by  categorical  programs  can  serve  to  catalyze  local 
(and  state)  commitment  when  the  local  time  Is  ripe. 

Therefore,  we  suggest  that  a fixed  proportion  of  funds  awarded  by 
the  states  under  Title  IV  C be  allocated  to  targeted  areas  (e.g.,  basic 
skills,  drop-out  prevention,  or  early  childhood  education).  Many  states 
currently  use  this  targeted  approach,  so  that  the  Intent  of  this  recom- 
mendation Is  primarily  to  spread  a practice  that  has  proven  effective  In 
several  states.  Because  the  conditions  and  problems  differ  for  each 
state,  the  fixed  proportion  as  well  as  the  specific  categories  should  be 
allowed  to  vary  from  state  to  state  and  should  be  submitted  by  the  states 
In  their  State  Plans  to  the  Office  of  Education  for  approval  and/or  ad- 
justment. Such  approval  would  enable  OE  to  exercise  a limited  leverage 
on  priorities  selected  by  the  states. 


States  should  key  their  awards  of  Title  IV  C funds  to  the  natural 
stages  of  the  local  Innovative  process  by  awarding  three  types  of  grants — 
a planning  grant  of  one  year  duration,  an  Implementation  grant  of  two  to 
three  years  duration,  and  an  Incorporation  grant  of  two  years  duration,’  ^ 

Federal  change  agent  programs  generally  award  fixed-term  grants  regard  ^ ^ 

less  of  the  school  district's  ability  to  Introduce  and  sustain  the  parti- 
cular Innovations  represented  In  their  proposals.  Yet  we  observed  simi- 
lar Innovations  being  approached  and  Installed  very  differently  by  school 
districts  according  to  their  capacities  to  Innovate.  For  example,  one 
district  attempting  to  Initiate  a remedial  mathematics  project  based  on 
Plage tlan  principals  was  struggling  to  operationalize  the  philosophical 
principles  of  the  project;  another  district  funded  at  the  same  time  and 
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at  an  equivalent  level  was  dealing  with  the  project  at  a higher  devel- 
opmental level — It  had  refined  the  philosophical  principles  to  meet 
local  needs  and  was  In  the  process  of  producing  classroom  materials. 

When  the  three-year  federal  grant  ran  out,  the  project  participants  In 
the  first  district  had  learned  to  deal  with  the  Innovation  but  the 
district  could  not  afford  to  continue  It;  the  other  district  had  used 
the  federal  money  to  begin  district-wide  dissemination. 

These  situations  are  but  two  of  the  many  cases  pointing  to  the 
need  for  a differential  funding  strategy.  Rather  than  blanket  awards 
for  a fixed  number  of  years,  states  could  award  grants  according  to 
whether  a school  district  Is  Initiating  a new  project.  Implementing  an 
already  planned  project  design,  or  Incorporating  within  the  district  a 
project  that  the  district  has  successfully  Implemented  on  a limited, 
trial  basis. 

The  award  to  Initiate  a new  project  would  be  a planning  grant  of 
one  year  duration  whose  purpose  would  be  twofold.  One,  the  planning 
grant  would  allow  districts  to  produce  a proposal  that  satisfied  a num- 
ber of  state  determined  criteria  (e.g.,  problem  Identification,  needs 
assessment,  and  personnel  assignment).  Two,  It  would  enable  districts 
to  engage  In  a planning  process  that  encouraged  participation  from  dif- 
ferent levels  In  the  local  school  system.  (Research  has  suggested  that 
such  participation  may  be  critical  to  successful  Innovations.)  If  a 
school  district  sought  a follow-on  grant.  It  would  be  required  to  show 
State  Educational  Agency  (SEA)  evaluators  that  Its  planning  process  In- 
volved broad  participation. 

The  award  for  project  Implementation  would  provide  resources  for 
up  to  three  years  for  districts  to  carry  out  new  educational  practices. 
Although  this  grant  would  be  similar  to  the  present  Title  IV  C award. 

It  would  be  preceded  by  the  planning  grant  process,  which  would  allow 
SEA  personnel  to  provide  formative  Input  to  LEAs  about  Implementation. 
Research  has  shown  that  the  strategies  chosen  to  Implement  a project  can 
be  pivotal  for  the  project's  success;  SEA  personnel  could  provide  use- 
ful and  tailored  advice  to  local  Implementors  on  appropriate  strategies. 

The  need  for  a project  Incorporation  grant  of  up  to  two  years 
arises  because  financial  considerations  often  limit  a school  district's 
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ability  to  sustain  or  spread  even  successful  Innovations  after  the  end 
of  the  federal  funding  period.  However,  In  addition  to  financial  con- 
siderations, we  found  that  unless  the  school  district  was  committed  to 
make  the  new  educational  practice  a standard  part  of  district  opera- 
tions, the  project  would  eventually  fade  away,  regardless  of  Its  past 
success  or  staff  Interest.  To  help  Insure  the  district's  commitment, 
states  should  (a)  require  matching  grants  from  LEAs  and/or  (b)  establish 
on-slte  visits  of  SEA  personnel  prior  to  the  award  of  an  Incorporation 
grant  to  evaluate  district  plans  and  purposes  as  well  as  to  offer  ad- 
vice. 

The  above  differential  funding  strategy  Implies  additional  admin- 
istrative costs  and  Increased  technical  assistance  burden  for  SEAs.  To 
allow  the  states  to  fulfill  these  responsibilities,  we  recommend  that 
(a)  the  SEA  entitlement  to  administer  Title  IV  be  Increased  from  the 
present  level  of  5 percent  to  7-1/2  percent  and  that  (b)  States  be  re- 
quired to  allocate  up  to  2-1/2  percent  of  their  non-admlnlstratlve 
Title  IV  funds  to  strengthen  their  leadership  resources  (as  stipulated 
In  Sec.  431)  with  the  percentage  commitment  In  each  case  to  be  submit- 
ted by  the  States  In  their  State  Plans  to  the  Office  of  Education  for 
approval  and/or  adjustment. 

4.  States  should  allocate  no  less  than  10  percent  of  their  Title  IV  C 
funds  to  leadership  training  and  staff  development  activities  of  local 
school  districts .k  The  Rand  study  found  that  Innovative  projects  were 
not  effectively  inmlemented  unless  (a)  they  received  a high  level  of 
leadership  from  principals  and  project  directors,  and  (b)  the  school 
district  engaged  In  sustained  staff  training  and  development  activities. 
The  limited  success  of  federal  change  agent  programs  can  be  traced.  In 
part,  to  uneven  and  often  Inadequate  local  leadership  and  staff  devel- 
opment activities.  Despite  the  Importance  of  these  critical  factors, 

I£As  usually  cannot  justify,  to  their  local  constltutents,  the  alloca- 
tion of  dls.:rlct  funds  for  purposes  of  Improving  middle- level  management 
and  conducting  In-service  development  for  teachers.  Federal  legislation, 
under  Title  IV  C,  that  provided  funding  for  local  leadership  training 
and  staff  development  would  also  help  legitimize  these  activities  within 


local  school  systems.  Although  there  is  no  single  "best"  approach  to 
leadership  training  and  staff  development  activities,  research  suggests 
that  the  states  should  design  awards  to  encourage:  (1)  regional  arrange- 
ments where  the  less  coin)etltive  districts  in  an  area  could  draw  on  the 
skills  of  the  stronger  districts,  and  (2)  the  use  of  peers  helping  their 
counterparts  (principals,  teachers,  nd.ddle-management,  and  superintend- 
ents) in  other  districts. 


